Imaging system, display system, and optical device including plurality of optical systems that have a plurality of optical axes

ABSTRACT

An imaging system includes: an imaging device; and an optical device that forms a subject image on an imaging plane of an imaging element and that is freely attachable to and detachable from the imaging device. The optical device includes a combination of a plurality of optical systems to provide a plurality of optical axes. The plurality of optical systems include: a plurality of first imaging optical systems; and a second imaging optical system having a view angle narrower than that of each of the plurality of first imaging optical systems. The plurality of first imaging systems are respectively arranged to surround the second imaging optical system, as viewed from a subject side.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority fromJapanese Patent Application No. 2014-022491, filed on Feb. 7, 2014, theentire contents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an imaging system, a display system,and an optical device.

2. Description of the Related Art

Conventionally, a multi-eye type camera has been known, which uses aso-called multi-eye lens (pantoscopic lens) combined of a plurality ofoptical systems and having a plurality of optical axes, and which formsa plurality of subject images on an imaging plane of an imaging elementby the multi-eye lens (for example, see Japanese Patent ApplicationLaid-open No. 2002-281361, hereinafter, referred to as “PatentLiterature 1”).

A multi-eye type camera described in Patent Literature 1 uses amulti-eye lens combined of four optical systems. The four opticalsystems are arranged at positions where subject images are able to berespectively formed in four areas divided by light shielding plates onthe imaging plane of the imaging element.

After shooting a subject, the multi-eye type camera performs imageprocessing on the shot image to generate a new image. Specifically, themulti-eye type camera extracts respective images corresponding to thefour areas from the shot image and synthesizes the respective images togenerate the new image.

SUMMARY OF THE INVENTION

In accordance with some embodiments, an imaging system, a displaysystem, and an optical device are presented.

In some embodiments, an imaging system includes: an imaging device; andan optical device that forms a subject image on an imaging plane of animaging element and that is freely attachable to and detachable from theimaging device. The optical device includes a combination of a pluralityof optical systems to provide a plurality of optical axes. The pluralityof optical systems include: a plurality of first imaging opticalsystems; and a second imaging optical system having a view anglenarrower than that of each of the plurality of first imaging opticalsystems. The plurality of first imaging systems are respectivelyarranged to surround the second imaging optical system, as viewed from asubject side.

In some embodiments, a display system includes: a display device; and anoptical device that forms a subject image on an imaging plane of animaging element and that is freely attachable to and detachable from thedisplay device. The optical device includes: a plurality of opticalsystems that have a plurality of optical axes with different view anglesand that respectively form subject images of a plurality of differentview angles on the imaging plane of the imaging element; and atransmitting unit that transmits positional information related topositions at which the subject images are formed. The display deviceincludes: a receiving unit that receives, when the optical device isattached to the display device, the positional information from theoptical device; and a display control unit that causes display of thesubject images of the plurality of different view angles to bechangeable according to a result of reception by the receiving unit.

In some embodiments, an optical device includes: an imaging optical unitthat includes a combination of a plurality of optical systems to providea plurality of optical axes and that respectively forms a plurality ofsubject images on an imaging plane of an imaging element by theplurality of optical systems; a characteristic information recordingunit that records therein respective characteristic information relatedto characteristics of the respective optical systems constituting theimaging optical unit; and a transmitting unit that transmits thecharacteristic information to a device that performs imaging incooperation with the optical device. The plurality of optical systemsinclude: at least one first imaging optical system; and a second imagingoptical system having a view angle narrower than that of the at leastone first imaging optical system.

The above and other features, advantages and technical and industrialsignificance of this invention will be better understood by reading thefollowing detailed description of presently preferred embodiments of theinvention, when considered in connection with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of an imagingsystem according to a first embodiment of the present invention;

FIG. 2 is a diagram schematically illustrating a configuration of animaging optical unit illustrated in FIG. 1;

FIG. 3 is a diagram schematically illustrating a configuration of theimaging optical unit illustrated in FIG. 1;

FIG. 4 is a diagram schematically illustrating a configuration of theimaging optical unit illustrated in FIG. 1;

FIG. 5 is a diagram schematically illustrating a configuration of theimaging optical unit illustrated in FIG. 1;

FIG. 6 is a diagram illustrating an example of characteristicinformation recorded in a first recording unit illustrated in FIG. 1;

FIG. 7 is a diagram illustrating a process of calculating a subjectdistance by a lens position instructing unit illustrated in FIG. 1;

FIG. 8 is a diagram illustrating an example of images displayed by adisplay unit illustrated in FIG. 1;

FIG. 9 is a flow chart illustrating operations of the imaging systemillustrated in FIG. 1;

FIG. 10 is a block diagram illustrating a configuration of an imagingsystem according to a second embodiment of the present invention;

FIG. 11 is a flow chart illustrating operations of the imaging systemillustrated in FIG. 10;

FIG. 12 is a diagram illustrating an example of images displayed by adisplay unit in an image synthesizing mode;

FIG. 13 is a diagram illustrating a modified example of the secondembodiment of the present invention;

FIG. 14 is a diagram schematically illustrating a configuration of animaging system according to a third embodiment of the present invention;

FIG. 15 is a block diagram illustrating a configuration of the imagingsystem illustrated in FIG. 14;

FIG. 16 is a flow chart illustrating operations of an optical deviceillustrated in FIG. 14 or FIG. 15;

FIG. 17 is a flow chart illustrating operations of a communicationdevice illustrated in FIG. 14 or FIG. 15;

FIG. 18 is a diagram schematically illustrating a configuration of animaging optical unit according to a fourth embodiment of the presentinvention;

FIG. 19 is a flow chart illustrating operations of an imaging systemaccording to the fourth embodiment of the present invention;

FIG. 20A is a diagram schematically illustrating a configuration of asecond telephoto lens according to a fifth embodiment of the presentinvention; and

FIG. 20B is a diagram schematically illustrating a configuration of thesecond telephoto lens according to the fifth embodiment of the presentinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, with reference to the drawings, modes for carrying out thepresent invention (hereinafter, referred to as “embodiments”) will bedescribed. The present invention is not limited by the embodimentsdescribed below. Furthermore, in describing the drawings, the same signsare appended to the same portions. Since the conventional use of asecond optical device having a single optical axis is a widelywell-known technique, description thereof will be simplified. In thiscase, although the range is changed by hand-shake correction ortrimming, one image is basically acquired by approximately the whole ofthe imaging element. It is already well known that focusing, averagephotometry, partial photometry, or the like is utilized in order toperform control of exposure and focus such that this whole image becomessatisfactory.

First Embodiment Schematic Configuration of Imaging System

FIG. 1 is a block diagram illustrating a configuration of an imagingsystem 1 according to a first embodiment of the present invention.

The imaging system 1 is configured as a digital camera, and asillustrated in FIG. 1, includes an optical device 2, and an imagingdevice 3, to which the optical device 2 is attached.

Configuration of Optical Device

Examples of the optical device 2 include a first optical device having aplurality of optical axes, and a second optical device having a singleoptical axis. As stated above, since the second optical device is of awell-known technique, hereinafter, a configuration of the first opticaldevice will be described intensively.

The optical device 2 has a function as a so-called interchangeable lens,and is attached freely detachably to the imaging device 3.

Hereinafter, main parts of the present invention will be mainlydescribed, as a configuration of the optical device 2.

This optical device 2 includes, as illustrated in FIG. 1, an imagingoptical unit 21, a drive unit 22, a position detecting unit 23, a firstrecording unit 24, a first communication unit 25, and a first controlunit 26.

The second optical device having the single optical axis is differentfrom the first optical device having the plurality of optical axes onlyin a configuration of its imaging optical unit, and has configurationscorresponding to the drive unit 22, the position detecting unit 23, thefirst recording unit 24, the first communication unit 25, and the firstcontrol unit 26.

FIG. 2 to FIG. 5 are diagrams schematically illustrating a configurationof the imaging optical unit 21. Specifically, FIG. 2 is a diagram of theimaging optical unit 21 as viewed from a subject side. FIG. 3 is a crosssection diagram along line III-III illustrated in FIG. 2. FIG. 4 is across section diagram along line IV-IV illustrated in FIG. 2. FIG. 5 isa diagram of the imaging optical unit 21 as viewed from above.

The imaging optical unit 21 is configured of a so-called multi-eye lens(pantoscopic lens) combined of a plurality of optical systems, condenseslight respectively from predetermined field areas, and forms images ofthe condensed light respectively on an imaging plane 311A (FIG. 2 andFIG. 5) of an imaging element 311 (FIG. 2 and FIG. 5) included in theimaging device 3. This imaging optical unit 21 includes, as illustratedin FIG. 1 to FIG. 5, a first left wide angle lens 211L (FIG. 1 to FIG. 3and FIG. 5), a first right wide angle lens 211R (FIG. 1 to FIG. 3 andFIG. 5), a second left wide angle lens 212L (FIG. 1 and FIG. 2), asecond right wide angle lens 212R (FIG. 1 and FIG. 2), and a telephotolens 213 (FIG. 1, FIG. 2, FIG. 4, and FIG. 5).

In FIG. 2 and FIG. 5, for convenience of explanation, each of the lenses211L, 211R, 212L, 212R, and 213 is artificially illustrated as a singlelens.

The first left wide angle lens 211L is a fixed focus wide angle lens,which is combined of a plurality of lens groups (FIG. 3), has a focaldistance comparatively short with respect to an imaging range, and has afocus position at a far distance. This lens may be said as having a wideview angle. That is, the first left wide angle lens 211L has a functionas a first imaging optical system according to the present invention.

The first left wide angle lens 211L is supported by a lens barrel(illustration thereof omitted) such that the first left wide angle lens211L is postured and positioned as described below in a state where theoptical device 2 has been attached to the imaging device 3.

The first left wide angle lens 211L is supported by the lens barrel suchthat the first left wide angle lens 211L is postured with its opticalaxis AxL (FIG. 3) vertical to the imaging plane 311A and is positioned,as viewed from the subject side, on the upper left of the center “O”(FIG. 2) of the imaging plane 311A. That is, the first left wide anglelens 211L forms a subject image in an area Ar1L (FIG. 2) on the upperleft in the imaging plane 311A.

The first right wide angle lens 211R is a wide angle lens having thesame function and configuration as the first left wide angle lens 211L(FIG. 3) and only a position, at which the first right wide angle lens211R is arranged inside the lens barrel, is different from that of thefirst left wide angle lens 211L. That is, the first right wide anglelens 211R has a function as a first imaging optical system according tothe present invention.

The first right wide angle lens 211R is supported by the lens barrelsuch that the first right wide angle lens 211R is postured with itsoptical axis AxR (FIG. 3) being parallel to the optical axis AxL (beingvertical to the imaging plane 311A) and positioned, as viewed from thesubject side, on the upper right of the center “O” of the imaging plane311A (FIG. 2). That is, the first right wide angle lens 211R forms asubject image in an area Ar1R (FIG. 2) on the upper right in the imagingplane 311A.

The second left wide angle lens 212L is a fixed focus wide angle lens,which is combined of a plurality of lens groups, has the same focaldistance as those of the first left and right wide angle lenses 211L and211R, and has a focus position at a near distance. That is, the secondleft wide angle lens 212L has a function as a first imaging opticalsystem according to the present invention.

The second left wide angle lens 212L is supported by the lens barrelsuch that the second left wide angle lens 212L is postured andpositioned as described below in the state where the optical device 2has been attached to the imaging device 3.

The second left wide angle lens 212L is supported by the lens barrelsuch that the second left wide angle lens 211L is postured with itsoptical axis (illustration thereof omitted) being parallel to theoptical axis AxL (being vertical to the imaging plane 311A) andpositioned, as viewed from the subject side, on the lower left of thecenter “O” of the imaging plane 311A (FIG. 2). That is, the second leftwide angle lens 212L forms a subject image in an area Ar2L (FIG. 2) onthe lower left in the imaging plane 311A.

The second right wide angle lens 212R is a wide angle lens having thesame function and configuration as the second left wide angle lens 212Land only a position, at which the second right wide angle lens 212R isarranged inside the lens barrel, is different from that of the secondleft wide angle lens 212L. That is, the second right wide angle lens212R has a function as a first imaging optical system according to thepresent invention.

The second right wide angle lens 212R is supported by the lens barrelsuch that the second right wide angle lens 212R is postured with itsoptical axis (illustration thereof omitted) being parallel to theoptical axis AxL (being vertical to the imaging plane 311A) andpositioned, as viewed from the subject side, on the lower right of thecenter “O” of the imaging plane 311A (FIG. 2). That is, the second rightwide angle lens 212R forms a subject image in an area Ar2R (FIG. 2) onthe lower right in the imaging plane 311A.

The telephoto lens 213 is a telephoto lens that is combined of two lensgroups (FIG. 4) and has a focal distance comparatively long with respectto its imaging range. This lens may be said as having a narrow viewangle. That is, the telephoto lens 213 has a function as a secondimaging optical system according to the present invention. Thistelephoto lens 213 is for largely shooting a far and small object thatfully covers the view angle, and the view angle is stopped by limiting(narrowing), not only the actual focal distance, but also the imagingarea to be used. As a result, many aberration correction lenses forsuppressing aberration up to a periphery of a screen are not required tobe provided, and thus designing with a comparatively simpleconfiguration and less lenses becomes possible, and more downsizing ascompared with the respective wide angle lenses 211L, 211R, 212L, and212R becomes possible. Therefore, aberration correction dependent on theview angle is eased and small sized and low cost designs are enabled. Adesign with a short full length is enabled with the telephoto lensconfiguration illustrated in FIG. 4, in which the front group has apositive power and the rear group has a negative power. For example, inorder to obtain the telephoto lens 213 corresponding to a 150-mm blockof a screen resulting from vertical and horizontal division of theimaging element 311 into seven, designing with a total lengthcorresponding to a wide angle lens of “140/7=20 mm” or less is possible.

An image quality by this lens having a narrow view angle (fortelephotography) is able to be enhanced by various measures forimproving qualities of images because a subject shot by this is alsoshootable via other lenses having a wide view angle. For example,distortion, a decrease in light quantity, or the like at a periphery ofa screen is able to be corrected by referring to an image of a wideangle lens, and qualities of images are able to be improved by asuper-resolution technique in the form of interpolating the imageacquired by the wide angle lens. Since such correction effects are ableto be expected, it may have a smaller configuration.

The telephoto lens 213 is supported by the lens barrel (illustrationthereof omitted) such that the telephoto lens 213 is postured andpositioned as described below in the state where the optical device hasbeen attached to the imaging device 3.

The telephoto lens 213 is supported by the lens barrel such that thetelephoto lens 213 is postured with its optical axis AxO being parallelto the optical axis AxL (being vertical to the imaging plane 311A) andis positioned at the center “O” of the imaging plane 311A as viewed fromthe subject side (FIG. 2). That is, the telephoto lens 213 forms asubject image in an area ArO (FIG. 2) at the center of the imaging plane311A.

Further, although a specific illustration thereof has been omitted, thetelephoto lens 213 is configured to be movable along the optical axisAxO inside the lens barrel. That is, the telephoto lens 213 is able tochange a focus (focus position).

As described above, the telephoto lens 213 is arranged to be surroundedby the first left and right wide angle lenses 211L and 211R and thesecond left and right wide angle lenses 212L and 212R, as viewed fromthe subject side. Further, the first left and right wide angle lenses211L and 211R and the second left and right wide angle lenses 212L and212R are arranged at positions such that the first left and right wideangle lenses 211L and 211R and the second left and right wide anglelenses 212L and 212R have the same separation distance D1 from theimaging plane 311A (FIG. 5). The telephoto lens 213 is arranged at aposition such that its separation distance D2 from the imaging plane311A is shorter than the separation distance D1 (FIG. 5). In otherwords, the telephoto lens 213 is arranged at a position more separatedfrom the subject than the first left and right wide angle lenses 211Land 211R and the second left and right wide angle lenses 212L and 212R.As a result, the telephoto lens 213 is prevented from protruding into ascreen of each of the wide angle lenses 211L, 211R, 212L, and 212R andcreating unnecessary dead angles or shadows. Further, an effect of ahood (for preventing flare) likely to be required for the telephoto lens213 is able to be obtained by the protrusion of these wide angle lenses211L, 211R, 212L, and 212R. Accordingly, since the protrusion of each ofthe wide angle lenses 211L, 211R, 212L, and 212R is allowed, by beingconfigured of a retrofocus type or the like in which the front group hasthe negative power and the rear group has the positive power asillustrated in FIG. 3, lens setting with a short focal distance withrespect to the full length is possible. For example, if one blockresulting from vertical and horizontal division of the imaging elementinto three is used, in order to obtain a wide angle corresponding to 30mm (by the 135 format conversion), the focal distance becomes “30/3=10mm”, but for retrofocusing, since a space equivalent to the focaldistance is formed behind the rear group lenses, by arranging aplurality of lenses in front thereof, the full length is able to bedesigned to be equal to or greater than the wide angle lens.

The drive unit 22 is configured by using a stepping motor, a DC motor,or the like, and under control by the first control unit 26, moves thetelephoto lens 213 along the optical axis AxO (changes the focusposition of the telephoto lens 213).

The position detecting unit 23 is configured by using aphoto-interrupter or the like, and detects a position of the telephotolens 213 driven by the drive unit 22, the position being on the opticalaxis AxO.

The first recording unit 24 records therein a control program executedby the first control unit 26, characteristic information related tocharacteristics of each of the lenses 211L, 211R, 212L, 212R, and 213,and the like.

That is, the first recording unit 24 has a function as a characteristicinformation recording unit according to the present invention.

FIG. 6 is a diagram illustrating an example of the characteristicinformation recorded in the first recording unit 24.

The characteristic information is, for example, as illustrated in FIG.6, information in which range information, optical axis coordinateinformation, focal distance information, focus adjustment information,use information, pair information, separation distance information, andthe like are associated with each of the lenses 211L, 211R, 212L, 212R,and 213.

The range information is information related to a range occupied by thesubject image formed on the imaging plane 311A by each of the lenses211L, 211R, 212L, 212R, and 213, and is information corresponding to theabove mentioned areas Ar1L, Ar1R, Ar2L, Ar2R, and ArO.

The optical axis coordinate information is information related tocoordinates that the optical axis of each of the lenses 211L, 211R,212L, 212R, and 213 passes on the imaging plane 311A. For example, theoptical axis coordinate information of the telephoto lens 213 isinformation related to coordinates of the center “O” on the imagingplane 311A.

The focal distance information is information related to the focaldistance of each of the lenses 211L, 211R, 212L, 212R, and 213. Thisfocal distance information is easier to be understood if normalized in aparticular imaging range, but may be numerical values convertible fromthe above described range information. Further, it may be view angleinformation, of course. Although not illustrated, information on thefocusing range or the like, may be included, similarly. As a result,determination of a subject at which distance should be shot by whichlens or the like becomes possible.

The focus adjustment information is information used when focusadjustment (autofocusing: AF) is performed, and is information in whicha subject distance from the imaging system 1 (optical device 2) to thesubject is associated with the position of the lens in a focused state.In the first optical device according to this first embodiment, a lenswith its focus position being changeable is only the telephoto lens 213and thus the focus adjustment information is associated only with thetelephoto lens 213. Of course, the wide angle lenses 211L, 211R, 212L,and 212R also may have their focus positions adjustable to have thisinformation. Further, information on the focusing range or the like maybe also included therein. As a result, instead of displaying all of theplurality of images, control to display only those shot underappropriate focus conditions becomes possible. Similar things can besaid for exposure, in addition to the focus positions.

The use information is information related to uses of the lenses 211L,211R, 212L, 212R, and 213. Specifically, the use information isinformation related to whether of not the lens is a lens to be used whenAF is performed. A plurality of fixed focus lenses are preferably usedas lenses for AF with their focal distances or the like being at fixedvalues, because factors of errors upon AF applying triangulation areeliminated. The lenses for AF may not be in a pair and as long as theirlens aperture is large, precision is expected to be increased by imagingplane phase difference AF with pixels for AF provided on the imagingelement. Since a lens diameter of this telephoto lens 213 is small andthis results in darkness, precision tends to lack in AF of this type,and thus AF applying triangulation is preferably combined therewith. Inthe first optical device according to this first embodiment, a pair ofthe first left and right wide angle lenses 211L and 211R or a pair ofthe second left and right wide angle lenses 212L and 212R is the lensesto be used when AF for the telephoto lens 213 is performed. Therefore,the use information is associated only with each of the lenses 211L,211R, 212L, and 212R.

The pair information is information indicating the counterpart lens whenthe lens is used as the pair when AF or the like is performed. Asdescribed above, in the first optical device according to this firstembodiment, the lenses used as the pair when AF of the telephoto lens213 is performed, are the pair of the first left and right wide anglelenses 211L and 211R, or the pair of the second left and right wideangle lenses 212L and 212R. Therefore, the pair information of the firstleft wide angle lens 211L is information indicating the first right wideangle lens 211R, and the pair information of the first right wide anglelens 211R is information indicating the first left wide angle lens 211L.Further, the pair information of the second left wide angle lens 212L isinformation indicating the second right wide angle lens 212R, and thepair information of the second right wide angle lens 212R is informationindicating the second left wide angle lens 212L.

The separation distance information is information related to theseparation distance D1 (FIG. 5) of the first left and right wide anglelenses 211L and 211R and the second left and right wide angle lenses212L and 212R from the imaging plane 311A. Therefore, the separationdistance information is associated only with each of the lenses 211L,211R, 212L, and 212R.

A second optical device having a single optical axis preferably has, ofthe above described information, the focal distance information (viewangle information) and focus adjustment information, as well asdiaphragm control information or the like.

The first communication unit 25 is a communication interface forelectrically connecting to the imaging device 3 and performingcommunication with the imaging device 3, when the optical device 2 isattached to the imaging device 3.

The first control unit 26 is configured by using a central processingunit (CPU) or the like, and controls operations of the optical device 2according to instruction signals from the imaging device 3, which areinput via the first communication unit 25. Further, the first controlunit 26 outputs, to the imaging device 3, a position of the telephotolens 213 detected by the position detecting unit 23, via the firstcommunication unit 25.

Configuration of Imaging Device

Hereinafter, main parts of the present invention will be mainlydescribed, as a configuration of the imaging device 3.

The imaging device 3 includes, as illustrated in FIG. 1, an imaging unit31, a display unit 32, an input unit 33, a second communication unit 34,a memory unit 35, a second recording unit 36, and a second control unit37.

Under control by the second control unit 37, the imaging unit 31 imagesa subject and generates image data. This imaging unit 31 is configuredby using: the imaging element 311 (FIG. 2 and FIG. 5), such as a chargecoupled device (CCD), which receives a subject image formed by theimaging optical unit 21 and converts the subject image into anelectrical signal; a signal processing unit (illustration thereofomitted), which generates digital image data by performing signalprocessing (A/D conversion or the like) on the electrical signal (analogsignal) from the imaging element 311; and the like.

The image data generated by the imaging unit 31 are sequentially stored,under control by the second control unit 37, into the memory unit 35.Further, if a shooting operation is performed on the input unit 33 by auser of the imaging system 1, under control by the second control unit37, the image data generated by the imaging unit 31 (image datacorresponding to a part of an image area according to the shootingoperation if the first optical device is attached (hereinafter, “partialimage data”), and image data corresponding to approximately the whole ofthe image area in the image data if the second optical device isattached) are recorded in the second recording unit 36.

The display unit 32 is configured by using a display panel made of aliquid crystal, organic electro-luminescence (EL), or the like, anddisplays, under control by the second control unit 37, various images.Further, the display unit 32 displays, under control by the secondcontrol unit 37, operation information of the imaging system 1,information related to shooting, and the like, as appropriate.

The input unit 33 is configured by using buttons, switches, a touchpanel, or the like for receiving user operations, and outputsinstruction signals according to the user operations to the secondcontrol unit 37.

The second communication unit 34 is a communication interface forelectrically connecting to the optical device 2 and performingcommunication with the first communication unit 25, when the opticaldevice 2 is attached to the imaging device 3.

The memory unit 35 stores therein the image data generated by theimaging unit 31, characteristic information received via the secondcommunication unit 34, and the like.

The second recording unit 36 includes, as illustrated in FIG. 1, aprogram recording unit 361 and an image data recording unit 362.

The program recording unit 361 stores therein various programs executedby the second control unit 37, various data used during the execution ofthe programs, and the like.

The image data recording unit 362 records therein, under control by thesecond control unit 37, image data (the partial image data if the firstoptical device is attached and the image data corresponding toapproximately the whole of the image area of the image data if thesecond optical device is attached) according to the shooting operationon the input unit 33 by a user of the imaging system 1. For thisshooting operation, the touch panel (input unit 33) on the display unit32 may be used, and the shooting operation is able to be selected easilyif a necessary image is specified on the display screen. Further, on thetouch panel, a necessary range of an image may be specified. Forexample, a slide operation may be detected as a frame or an area may bemade to be able to be specified by a pinch operation. If such means areused, without taking out and displaying a particular area (for example,the above described area Ar1L, Ar1R, Ar2L, Ar2R, or ArO) specified bythe optical device 2 from an image captured by the imaging element 311,a valid area of each lens may be made to be able to be specifiedmanually. If focusing and exposure adjustment are enabled by these touchoperations also in a second optical device having a single optical axis,operations by similar actions become possible. Further, trimming or thelike may be made possible from an image acquired by a second opticaldevice having a single optical axis by a similar pinch operation or thelike.

The second control unit 37 is configured by using a CPU or the like, andcomprehensively controls operations of the imaging system 1 byperforming transfer or the like of instructions and data correspondingto respective units forming the imaging system 1 according to theinstruction signals or the like from the input unit 33. This secondcontrol unit 37 includes, as illustrated in FIG. 1, a characteristicinformation acquiring unit 371, a lens position instructing unit 372, animage extracting unit 373, a display control unit 374, and an imagingcontrol unit 375.

The characteristic information acquiring unit 371 acquirescharacteristic information from the optical device 2 by requesting theoptical device 2 to transmit the characteristic information, via thesecond communication unit 34. The characteristic information acquiringunit 371 stores the acquired characteristic information in the memoryunit 35.

The lens position instructing unit 372 executes, as described below, anAF process of a lens for which the focus position is changeable (thetelephoto lens 213 in the first optical device according to this firstembodiment), of the lenses included in the optical device 2.

Specifically, the lens position instructing unit 372 calculates, basedon the characteristic information and the latest image data stored inthe memory unit 35, a subject distance from the imaging system 1(optical device 2) to the subject. Further, the lens positioninstructing unit 372 acquires, based on focus adjustment informationincluded in the characteristic information stored in the memory unit 35,a position of the telephoto lens 213 on its optical axis ArOcorresponding to the calculated subject distance. The lens positioninstructing unit 372 then transmits positional information related tothe acquired position of the telephoto lens 213 to the optical device 2via the second communication unit 34.

Specifically, the lens position instructing unit 372 calculates thesubject distance, as described below, by using the principle oftriangulation.

FIG. 7 is a diagram illustrating a process of calculating the subjectdistance by the lens position instructing unit 372. Specifically, FIG. 7is, similarly to FIG. 5, a diagram of the imaging system 1 as viewedfrom above.

First, the lens position instructing unit 372 identifies, based on theuse information and pair information included in the characteristicinformation stored in the memory unit 35, the lenses forming the pair tobe used in performing AF of the telephoto lens 213 (the pair of thefirst left and right wide angle lenses 211L and 211R, or the pair of thesecond left and right wide angle lenses 212L and 212R).

In the following description, the lenses forming that pair are assumedto be identified as the first left and right wide angle lenses 211L and211R.

Next, the lens position instructing unit 372 recognizes, based on therange information included in the characteristic information stored inthe memory unit 35, the areas Ar1L and Ar1R where the first left andright wide angle lenses 211L and 211R form their subject images in theimaging plane 311A.

Next, the lens position instructing unit 372 reads the latest image datastored in the memory unit 35, and calculates a position (coordinates) ofthe subject image (“bird” in the example of FIG. 7) photographed in thearea Ar1L or the area Ar1R in the image area of the latest image data.

Next, the lens position instructing unit 372 recognizes, based on theoptical axis coordinate information included in the characteristicinformation stored in the memory unit 35, coordinates of the opticalaxes AxL and AxR of the first left and right wide angle lenses 211L and211R. The lens position instructing unit 372 then calculates a distance“B” between the recognized coordinates and calculates a deviation amount“X” between the coordinates of the optical axis AxL or optical axis AxR(the optical axis AxL in the example of FIG. 7) and the above describedcalculated position of the subject image.

Next, the lens position instructing unit 372 recognizes, based on theseparation distance information included in the characteristicinformation stored in the memory unit 35, a separation distance D1 ofthe first left and right wide angle lenses 211L and 211R from theimaging plane 311A.

After the above processing, the lens position instructing unit 372calculates, based on the following Equation (1), a subject distance “L”.L=B·X/D1  (1)

The image extracting unit 373 reads the latest image data stored in thememory unit 35. The image extracting unit 373 then extracts, based onthe range information included in the characteristic information storedin the memory unit 35, partial image data corresponding to each of areasbased on the range information in the image area of the latest imagedata (the areas Ar1L, Ar1R, Ar2L, Ar2R, and ArO in the first opticaldevice according to this first embodiment). Further, the imageextracting unit 373 stores the partial image data in association withtheir corresponding characteristic information in the memory unit 35 inorder to make the extracted partial image data identifiable. Forexample, the image extracting unit 373 stores the partial image data ofthe area Ar1L in association with the characteristic information of thefirst left wide angle lens 211L corresponding thereto, in the memoryunit 35.

The display control unit 374 controls operations of the display unit 32and causes the display unit 32 to display images.

FIG. 8 is a diagram illustrating an example of the images displayed bythe display unit 32. In FIG. 8, similarly to FIG. 5 and FIG. 7, thesubject is “bird”.

Specifically, the display control unit 374 identifies, based on thecharacteristic information associated with each partial image datastored in the memory unit 35, those corresponding partial image data. Asillustrated in FIG. 8, the display control unit 374 causes the displayunit 32 to display (live view display) each of: first representativeimage MF1, which is an image corresponding to the partial image data ofthe area ArO; a second representative image MF2, which is an imagecorresponding to the partial image data of one of the areas Ar1L, Ar1R,Ar2L, and Ar2R (for example, the partial image data that are in afocused state, of the partial image data of the areas Ar1L, Ar1R, Ar2L,and Ar2R); and sub images SF1 to SF3, which are images corresponding tothe partial image data of the other three of the areas Ar1L, Ar1R, Ar2L,and Ar2R, the images having a size smaller than those of the first andsecond representative images MF1 and MF2, by lining up these images MF1,MF2, and SF1 to SF3. The respective images MF1, MF2, and SF1 to SF3 maybe not displayed by being lined up, and may be sequentially displayed bybeing switched over with one another.

If a shooting operation (an operation of selecting any of the respectiveimages MF1, MF2, and SF1 to SF3 displayed by the display unit 32) on theinput unit 33 by a user of the imaging system 1 is performed, theimaging control unit 375 records the partial image data corresponding tothe selected image in the image data recording unit 362. When that isdone, a plurality of images may be caused to be able to be synthesizedand recorded. Further, an image once selected may be controlled to beprioritized in the next shooting. Furthermore, an image quality by alens having a narrow view angle (for telephotography) is able to beenhanced by various measures for improving qualities of images because asubject shot by this is also shootable via other lenses having a wideview angle. For example, distortion, a decrease in light quantity, orthe like at a periphery of a screen is able to be corrected by referringto an image of a wide angle lens, and qualities of images are able to beimproved by a super-resolution technique in the form of interpolatingthe image acquired by the wide angle lens. Since such correction effectsare able to be expected, it may have a smaller configuration. Similarly,needless to say, by using images acquired by a plurality of lenses,image qualities of images by wide angle lenses are able to be improvedand application of processing the images into a panoramic image or athree dimensional image is possible. This may be performed by thedisplay control unit 374 or the like of the imaging device 3, and may beaided by providing a dedicated circuit in the second control unit 37 orrecording a dedicated image processing program in the program recordingunit 361. The image quality may be improved when the image data arerecorded, and application of transmitting the image data to the outsideand improving the image quality at an external device is also possible.By the three dimensional information, artistic expression or the likeadded with depth information becomes possible and even richer imageexpression is realized.

Operations of Imaging System

Next, operations of the above described imaging system 1 will bedescribed.

For the operations described below, the optical device 2 is assumed tobe already attached to the imaging device 3.

FIG. 9 is a flow chart illustrating the operations of the imaging system1.

If power of the imaging system 1 is turned ON by an operation on theinput unit 33 by a user of the imaging system 1 (Step S101: Yes), thesecond control unit 37 determines whether or not the imaging system 1has been set in a shooting mode by an operation on the input unit 33 bythe user of the imaging system 1 (Step S102).

If the imaging system 1 is determined to have been set in the shootingmode (Step S102: Yes), the characteristic information acquiring unit 371requests the optical device 2, via the second communication unit 34, totransmit the characteristic information. The optical device 2 (firstcontrol unit 26) that has received that transmission request transmits,via the first communication unit 25, the characteristic informationrecorded in the first recording unit 24, to the imaging device 3. Thecharacteristic information acquiring unit 371 acquires thecharacteristic information from the optical device 2 and stores thecharacteristic information in the memory unit 35 (Step S103).

Subsequently, the second control unit 37 determines whether or not theoptical device 2 that has been attached to the imaging device 3 is afirst optical device (whether or not a multi-eye lens is used) (StepS104). For example, the second control unit 37 determines, based on thecharacteristic information acquired in Step S103, that a multi-eye lensis used, if plural sets of characteristic information are presentcorrespondingly with the respective lenses included in the imagingoptical unit. That is, the second control unit 37 determines whether ornot a multi-eye lens is used (whether a first optical device is attachedor a second optical device is attached) by communicating informationwith the optical device 2 (Step S103).

Depending on the optical device 2, such a shooting device or system maybe configured by using a fixed focus lens group not electricallycontrolled. In this case, similar effects are obtained even ifelectrical information communication is not performed. For example, fromfeatures of an acquired image or the like, whether or not a multi-eyelens is used may be determined from an image captured by the imagingelement 311. When that is done, by providing means, such as designing apredetermined position to be at the optical center or selecting andinputting a lens type, an imaging device (camera) that obtains theoriginal effects of the present invention is able to be provided with asimple configuration. For a camera having a touch panel type displayunit, a necessary area may be selected from an acquired image on thetouch panel. The electrical communication may be performedrestrictively, and means for displaying a distance of a subject frominformation of an image acquired by a pair of lenses or for performingfocus assisting display may be provided. In this case, the finalfocusing is performed by a user performing manual adjustment whileviewing the display. Further, a plurality of images are acquired by theimaging element 311 from a first optical device having a plurality ofoptical systems having different optical axes, but according tocharacteristics and the result of adjustment of each optical system,each image has a different image quality, such as a different exposure,a different focus, or the like, and thus setting of which image is to bevalid is important. Further, in an imaging element or the like that isable to perform a different imaging process for each image, depending onthe taste, image processing and imaging control for each area becomeimportant. Therefore, in such a multi-eye system, a function ofselecting an area becomes important. From the view point of areaselection, if focusing and exposure adjustment are enabled by this touchoperation also in a second optical device having a single optical axis,operations by similar actions become possible. Further, trimming or thelike may be made possible from an image acquired by a second opticaldevice having a single optical axis by a similar pinch operation or thelike. In this case, the electrical communication may be performed or notperformed, but if focusing is to be automatically performed or adiaphragm is desired to be controlled from the imaging device side,electrical communication is preferably made available. Where each imageis acquired for each optical axis upon this multi-eye use is able to bedetermined at the imaging device side by performing image determinationor the like of whether the optical axis directions are approximatelyequal to one another, or whether similar images are arranged accordingto a particular rule. For example, for a multi-eye lens like that ofFIG. 2 or FIG. 18, since lenses of similar specifications are arrangedon a diagonal line, if similar images are arranged on a diagonal line, amulti-eye lens is determined to be used, and since light does not reachbetween lenses and this results in darkness, from image informationindicating regular occurrences of dark portions or the like, cameracontrol of automatically determining a valid area of each image of themulti-eye lens may be performed. This may be simplified by a service,such as that for downloading a control program for each lens. For such adownloading system, if communicatable with the optical device 2, aresult of the communication may be prioritized, and if notcommunicatable, download information may be prioritized. In any case,not all of the information illustrated in FIG. 6 needs to becommunicated.

If a multi-eye lens is determined to be used (Step S104: Yes), thesecond control unit 37 causes the imaging unit 31 to start imaging (StepS105). Image data generated by the imaging unit 31 are then sequentiallystored in the memory unit 35.

Subsequently, the lens position instructing unit 372 calculates asubject distance, based on the characteristic information and the latestimage data stored in the memory unit 35 (Step S106), and transmits,based on the focus adjustment information included in the characteristicinformation, positional information of the telephoto lens 213corresponding to the calculated subject distance (Step S107). Whilechecking the position of the telephoto lens 213 on the optical axis AxOdetected by the position detecting unit 23, the optical device 2 (firstcontrol unit 26) that has received the positional information of thetelephoto lens 213 causes the drive unit 22 to operate to position thetelephoto lens 213 at a position based on the received positionalinformation.

Subsequently, the image extracting unit 373 reads the latest image datastored in the memory unit 35 and respectively extracts, based on therange information included in the characteristic information stored inthe memory unit 35, the partial image data corresponding to the areasAr1L, Ar1R, Ar2L, Ar2R, and ArO in the image area of the latest imagedata (Step S108). Further, the image extracting unit 373 stores theextracted partial image data in association with their correspondingcharacteristic information into the memory unit 35.

Subsequently, the display control unit 374 identifies, based on thecharacteristic information associated with each partial image datastored in the memory unit 35, those corresponding partial image data,and causes the display unit 32 to perform live view display (FIG. 8)thereof (Step S109).

In the live view display illustrated in FIG. 8, the image correspondingto the partial image data of the area ArO is the first representativeimage MF1, the image corresponding to the partial image data of any oneof the areas Ar1L, Ar1R, Ar2L, and Ar2R is the second representativeimage MF2, and images corresponding to the partial image data of theother three of the areas Ar1L, Ar1R, Ar2L, and Ar2R are the sub imagesSF1 to SF3, but not being limited thereto, for example, according tooperations on the input unit 33 by a user of the imaging system 1,images to be the first and second representative images and sub imagesmay be configured to be changeable as appropriate. Further, sizes of thefirst and second representative images and sub images may be configuredto be changeable as appropriate according to those operations.

Subsequently, the imaging control unit 375 determines whether or not ashooting operation on the input unit 33 by a user of the imaging system1 has been performed (Step S110).

If it is determined that there has not been any shooting operation (StepS110: No), the imaging system 1 proceeds to Step S112.

On the contrary, if the imaging control unit 375 determines that therehas been a shooting operation (Step S110: Yes), the imaging control unit375 records the partial image data corresponding to the image selectedby the shooting operation, of the images displayed by the display unit32 (in the example of FIG. 8, the images MF1, MF2, and SF1 to SF3) intothe image data recording unit 362 (Step S111).

After Step S111, or after it is determined, “No”, in Step S110, if thepower of the imaging system 1 is turned OFF by an operation on the inputunit 33 by a user of the imaging system 1 (Step S112: Yes), the imagingsystem 1 ends this process.

On the contrary, if the state where the power is ON is continuing (StepS112: No), the imaging system 1 returns to Step S105.

If it is determined that a multi-eye lens is not used (that a secondoptical device having a single optical axis is used) (Step S104: No),the second control unit 37 causes, similarly to Step S105, the imagingunit 31 to start imaging (Step S113), executes a normal AF processconventionally known widely (Step S114), and executes live view display(Step S115).

For the live view display (Step S115), the second control unit 37 causesthe display unit 32 to display the image corresponding to the latestimage data (the image of approximately the whole image area) stored inthe memory unit 35 in Step S113.

Subsequently, the imaging control unit 375 determines whether or not ashooting operation on the input unit 33 by a user of the imaging system1 has been performed (Step S116).

If it is determined that there has not been any shooting operation (StepS116: No), the imaging system 1 proceeds to Step S118.

On the contrary, if the imaging control unit 375 determines that therehas been a shooting operation (Step S116: Yes), the imaging control unit375 records the image data corresponding to the image, which the displayunit 32 was caused to display upon the shooting operation, into theimage data recording unit 362 (Step S117).

After Step S117, or after it is determined, “No”, in Step S116, if thepower of the imaging system 1 is turned OFF by an operation on the inputunit 33 by a user of the imaging system 1 (Step S118: Yes), the imagingsystem 1 ends this process.

On the contrary, if the state where the power is ON is continuing (StepS118: No), the imaging system 1 returns to Step S113.

As described above, the imaging device 3 (the second control unit 37)according to this first embodiment changes the imaging control and thedisplay control between the time of attaching the first optical deviceand the time of attaching the second optical device by executing StepsS105 to S111 when the first optical device is attached to the imagingdevice 3 and executing Steps S113 to S117 when the second optical deviceis attached to the imaging device 3.

That is, the imaging system 1 has functions as an imaging system and adisplay system according to the present invention. Further, the imagingdevice 3 has functions as an imaging device and a display deviceaccording to the present invention. Further, the second control unit 37has a function as a control unit according to the present invention.

If it is determined that the imaging system 1 has not been set in theshooting mode (Step S102: No), the second control unit 37 determineswhether or not the imaging system 1 has been set in a playback mode byan operation on the input unit 33 by a user of the imaging system 1(Step S119).

If it is determined that the imaging system 1 has not been set in theplayback mode (Step S119: No), the imaging system 1 returns to StepS101.

On the contrary, if it is determined that the imaging system 1 has beenset in the playback mode (Step S119: Yes), the display control unit 374causes the display unit 32 to display the images corresponding to theimage data and partial image data, which have been recorded in the imagedata recording unit 362 (Step S120).

Subsequently, the display control unit 374 determines whether or not aninstruction signal instructing a change of images has been input by anoperation on the input unit 33 by a user of the imaging system 1 (StepS121).

If the display control unit 374 determines that the instruction signalinstructing a change of images has been input (Step S121: Yes), thedisplay control unit 374 changes the images to be displayed by thedisplay unit 32 (Step S122). After Step S122, the imaging system 1returns to Step S120.

On the contrary, if it is determined that the instruction signalinstructing a change of images has not been input (Step S121: No), theimaging system 1 returns to Step S101.

The imaging device 3 according to this first embodiment includes theabove described second control unit 37. That is, an effect of being ableto freely use the first and second optical devices to enjoy subjectimages with various expressions is achieved by the second control unit37 changing the imaging control and display control between the time ofattaching the first optical device to the imaging device 3 and the timeof attaching the second optical device to the imaging device 3.

Further, the imaging device 3 according to this first embodimentdetermines that the first or second optical device has been attached tothe imaging device 3 by the information communication with the opticaldevice 2 and the images captured by the imaging element 311, and thuswhether the first or second optical device has been attached is able tobe determined easily and accurately.

Further, the first optical device according to this first embodimentincludes the imaging optical unit 21, which has the first left and rightwide angle lenses 211L and 211R, the second left and right wide anglelenses 212L and 212R, and the telephoto lens 213, and the firstrecording unit 24, which records therein the characteristic informationrelated to the characteristics of each of the lenses 211L, 211R, 212L,212R, and 213.

Therefore, even if the first optical device is configured as aninterchangeable lens, the imaging device 3 is able to grasp thecharacteristics of each of the lenses 211L, 211R, 212L, 212R, and 213 byacquiring the characteristic information recorded in the first recordingunit 24. In particular, the characteristic information includes therange information related to the ranges occupied by the respectivesubject images formed on the imaging plane 311A of the imaging element311 by the respective lenses 211L, 211R, 212L, 212R, and 213 (the areasAr1L, Ar1R, Ar2L, Ar2R, and ArO). That is, based on the rangeinformation included in the characteristic information, the imagingdevice 3 is able to grasp in which range of the imaging plane 311A ofthe imaging element 311 each of the lenses 211L, 211R, 212L, 212R, and213 will form the subject image, and by performing image processing(extraction of the partial image data corresponding to the areas Ar1L,Ar1R, Ar2L, Ar2R, and ArO), generation and display of various images(for example, the images MF1, MF2, and SF1 to SF3 illustrated in FIG. 8)become possible.

Therefore, by the first optical device according to this firstembodiment, effects similar to those of the imaging device 3 asdescribed above are achieved.

Further, in the first optical device according to this first embodiment,the characteristic information includes the pair information indicatingthe counterpart lens used as the pair when AF of the telephoto lens 213is performed.

Therefore, based on the pair information and range information includedin the characteristic information, the imaging device 3 is able todistinguish easily which partial image data need to be used when AF ofthe telephoto lens 213 is performed and is able to execute the AF of thetelephoto lens 213 quickly.

In particular, since the telephoto lens 213 has a shallow depth offield, performing AF as described above is very effective.

Further, in the first optical device according to this first embodiment,the telephoto lens 213, which has a narrow view angle, is arranged atthe center, and each of the wide angle lenses 211L, 211R, 212L, and212R, which has a wide view angle, is arranged to surround the telephotolens 213, as viewed from the subject side.

Therefore, in all of the images (partial image data) formed by therespective lenses 211L, 211R, 212L, 212R, and 213, the same subjectimage (for example, the bird illustrated in FIG. 5 and FIG. 7) is ableto be included.

In particular, the telephoto lens 213 is arranged at a position moreseparate from the subject than each of the wide angle lenses 211L, 211R,212L, and 212R. Therefore, the view angle of each of the wide anglelenses 211L, 211R, 212L, and 212R is prevented from being confined bythe telephoto lens 213, and optimum arrangement not causing vignettingin each image (partial image data) is able to be realized.

Second Embodiment

Next, a second embodiment of the present invention will be described.

In the description below, to configurations and steps similar to thoseof the above described first embodiment, the same signs will beappended, and detailed description thereof will be omitted orsimplified.

An imaging device according to this second embodiment has a mode ofdisplaying images, which is different from that of the imaging system 1described above in the first embodiment.

Hereinafter, a configuration of an imaging system according to thissecond embodiment will be described.

Configuration of Imaging System

FIG. 10 is a block diagram illustrating a configuration of an imagingsystem 1A according to the second embodiment of the present invention.

A second control unit 37A included in the imaging system 1A (imagingdevice 3A) according to this second embodiment has, as illustrated inFIG. 10, an image generating unit 376 added, as compared to the imagingsystem 1 (FIG. 1) described above in the first embodiment.

The image generating unit 376 reads, based on the pair informationincluded in the characteristic information associated with therespective partial image data stored in the memory unit 35, therespective partial image data corresponding to the lenses used as a pair(the pair of the first left and right wide angle lenses 211L and 211R,or the pair of the second left and right wide angle lenses 212L and212R). The image generating unit 376 then synthesizes the respectiveimages corresponding to the read respective partial image data togenerate a panoramic image, and stores panoramic image datacorresponding to the panoramic image into the memory unit 35.

That is, the image generating unit 376 has a function as a panoramicimage generating unit according to the present invention.

A display control unit 374A and an imaging control unit 375A accordingto this second embodiment have some of their functions being changedaccording to the addition of the above described image generating unit376, as compared to the display control unit 374 and the imaging controlunit 375 described above in the first embodiment.

Operations of Imaging System

Next, operations of the imaging system 1A according to this secondembodiment will be described.

FIG. 11 is a flow chart illustrating the operations of the imagingsystem 1A.

The operations of the imaging system 1A according to this secondembodiment are, as illustrated in FIG. 11, different from the operationsof the imaging system 1 described above in the second embodiment (FIG.9) in that Steps S123 and S124 are added and Steps S109A and S111A areused instead of Steps S109 and S111.

Therefore, hereinafter, only Steps S123, S124, S109A, and S111A will bedescribed.

Step S123 is executed after Step S108.

Specifically, the second control unit 37A determines whether or not theimaging system 1A has been set in an image synthesizing mode by anoperation on the input unit 33 by a user of the imaging system 1A (StepS123).

If it is determined that the imaging system 1A has been set in the imagesynthesizing mode (Step S123: Yes), the image generating unit 376 reads,based on the pair information included in the characteristic informationassociated with each partial image data stored in the memory unit 35 inStep S105, the respective partial image data corresponding to the firstleft and right wide angle lenses 211L and 211R used as the pair. Theimage generating unit 376 then synthesizes the respective imagescorresponding to the read respective partial image data (the respectiveimages of the areas Ar1L and Ar1R) to generate a panoramic image, andstores panoramic image data corresponding to the panoramic image intothe memory unit 35 (Step S124).

On the contrary, if it is determined that the imaging system 1A has notbeen set in the image synthesizing mode (Step S123: No), the imagingsystem 1A returns to Step S109A.

After Step S124, or after it is determined, “No”, in Step S123, thedisplay control unit 374A causes the display unit 32 to perform liveview display (Step S109A).

The live view display (Step S109A) in the case where the imaging system1A has not been set in the image synthesizing mode (Step S123: No) isprocessed similarly to the live view display (Step S109 described abovein the first embodiment (for example, see FIG. 8).

The live view display (Step S109A) in the case where the imaging system1A has been set in the image synthesizing mode (Step S123: Yes) is asfollows.

FIG. 12 is a diagram illustrating an example of images live viewdisplayed by the display unit 32 in the image synthesizing mode.

Specifically, the display control unit 374A identifies, based on thecharacteristic information associated with each partial image datastored in the memory unit 35, the corresponding partial image data. Asillustrated in FIG. 12, the display control unit 374A causes the displayunit 32 to display (live view display) each of: a third representativeimage MF3, which is an image corresponding to the panoramic image datastored in the memory unit 35; and sub images SF4 to SF6, which areimages corresponding to the areas ArO, Ar2L, and Ar2R not used in thegeneration of the panoramic image by the image generating unit 376, theimages having a size smaller than that of the third representative imageMF3, by lining up these respective images MF3 and SF4 to SF6. Therespective images MF3 and SF4 to SF6 may be not displayed by being linedup, and may be displayed sequentially by being switched over with oneanother.

In the live view display illustrated in FIG. 12, the image correspondingto the panoramic image data is the third representative image MF3 andthe images corresponding to the areas ArO, Ar2L, and Ar2R not used inthe generation of the panoramic image are the sub images SF4 to SF6, butnot being limited thereto, for example, images to become the thirdrepresentative image and sub images may be configured to be changeableas appropriate according to operations on the input unit 33 by a user ofthe imaging system 1A. Further, according to those operations, sizes ofthe third representative image and sub images may be configured to bechangeable as appropriate.

If the imaging control unit 375A determines that a shooting operationhas been performed (Step S110: Yes), the imaging control unit 375Arecords, into the image data recording unit 362, the panoramic imagedata or the partial image data corresponding to the image selected bythe shooting operation from the images displayed by the display unit 32(the images MF1, MF2, and SF1 to SF3 illustrated in the example of FIG.8 if not set in the image synthesizing mode and the images MF3 and SF4to SF6 illustrated in the example of FIG. 12 if set in the imagesynthesizing mode) (Step S108A).

Similarly to the above described first embodiment, in this secondembodiment also, the characteristic information of whether the opticaldevice 2 attached is a first optical device or a second optical devicemay be acquired by electrical communication with the optical device 2.Depending on the optical device 2, such a shooting device or systemmaybe configured by using a fixed focus lens group not electricallycontrolled. In this case, from features or the like of acquired images,whether or not a multi-eye lens (first optical device) has been attachedmay be determined, and characteristics thereof may be determined fromimages captured by the imaging element 311. Where each image is acquiredfor each optical axis upon use of this multi-eye lens is able to bedetermined at the imaging device (camera) side by performing imagedetermination or the like of whether the optical axis directions areapproximately equal to one another, or whether similar images arearranged according to a particular rule. For example, for a multi-eyelens like that of FIG. 2 or FIG. 18, since lenses of similarspecifications are arranged on a diagonal line, if similar images arearranged on a diagonal line, a multi-eye lens is determined to be used,and since light does not reach between lenses and this results indarkness, from image information indicating regular occurrences of darkportions or the like, camera control of automatically determining avalid area of each image of the multi-eye lens may be performed. Thismay be simplified by a service, such as that for downloading a controlprogram for each lens. For such a downloading system, if communicatablewith the optical device 2, a result of the communication may beprioritized, and if not communicatable, download information may beprioritized. In any case, not all of the information illustrated in FIG.6 needs to be communicated. By providing means, such as designing apredetermined position to be at the optical center or selecting andinputting a lens type, a camera that obtains the original effects of thepresent invention is able to be provided with a simple configuration.For a camera having a touch panel type display unit, a necessary areamay be caused to be selected from an acquired image on the touch panel.The electrical communication may be performed restrictively, andmeasures for displaying a distance of a subject from information of animage acquired by a pair of lenses or for performing focus assistingdisplay may be provided. In this case, the final focusing is performedby the user performing manual adjustment while viewing the display.Further, a plurality of images are acquired by the imaging element 311from a first optical device having a plurality of optical systems havingdifferent optical axes, but each image has a different image quality,such as a different exposure, a different focus, or the like, accordingto characteristics and the result of adjustment of each optical system,each image has a different image quality, such as a different exposure,a different focus, or the like, and thus setting of which image is to bevalid is important. Further, in an imaging element or that like that isable to perform a different imaging process for each image, depending onthe taste, image processing and imaging control for each area becomeimportant. Therefore, in such a multi-eye system, a function ofselecting an area becomes important. From the view point of areaselection, if focusing and exposure adjustment are enabled by this touchoperation also in a second optical device having a single optical axis,operations by similar actions become possible. Further, trimming or thelike may be enabled from an image acquired by a second optical devicehaving a single optical axis by a similar pinch operation or the like.In this case, the electrical communication may be performed or notperformed, but if focusing is to be automatically performed or adiaphragm is desired to be controlled from the imaging device side,electrical communication is preferably made available.

Even with a configuration in which a panoramic image is generated anddisplayed as described above in this second embodiment, effects similarto those of the above described first embodiment are able to beachieved.

Modified Example of Second Embodiment

FIG. 13 is a diagram illustrating a modified example of the secondembodiment.

In the above described second embodiment, the image generating unit 376generates a panoramic image, but not being limited thereto, the imagegenerating unit 376 may be configured to generate a superimposed imagedescribed below.

Specifically, the image generating unit 376 executes the followingprocess at Step S124.

The image generating unit 376 reads, based on the characteristicinformation associated with each partial image data stored in the memoryunit 35, the partial image data corresponding to any of the first leftand right wide angle lenses 211L and 211R, and the second left and rightwide angle lenses 212L and 212R. The image generating unit 376 thengenerates, based on the range information included in the characteristicinformation stored in the memory unit 35, a superimposed image resultingfrom superimposition of instruction information instructing a placecorresponding to the area ArO (in the example of FIG. 13, a broken lineof a rectangular frame) on the image corresponding to the read partialimage data, and stores superimposed image data corresponding to thesuperimposed image in the memory unit 35.

That is, the image generating unit 376 has a function as a superimposedimage generating unit according to the present invention.

Further, if set in the image synthesizing mode (Step S123: Yes), thedisplay control unit 374A executes the following process at Step S109A.

The display control unit 374A identifies, based on the characteristicinformation associated with each partial image data stored in the memoryunit 35, the corresponding partial image data. As illustrated in FIG.13, the display control unit 374A causes the display unit 32 to display(live view display) a fourth representative image MF4, which is an imagecorresponding to the superimposed image data stored in the memory unit35 (an image resulting from superimposition of instruction informationFI on the first representative image MF1) and sub images SF7 to SF9,which are images corresponding respectively to three of the areas Ar1L,Ar1R, Ar2L, and Ar2R not used in the generation of the superimposedimage by the image generating unit 376, the sub images SF7 to SF9 havinga size smaller than that of the fourth representative image MF4, bylining up the respective images MF4 and SF7 to SF9. The respectiveimages MF4 and SF7 to SF9 may be not displayed by being lined up, andmay be displayed sequentially by being switched over with one another.

Third Embodiment

Next, a third embodiment of the present invention will be described.

In the description below, to configurations similar to those of theabove described first embodiment, the same signs will be appended, anddetailed description thereof will be omitted or simplified.

In the above described first embodiment, the optical device 2 does nothave an imaging element provided therein, and has a function as aso-called interchangeable lens.

In contrast, an optical device according to this second embodiment hasan imaging element provided therein, and the optical device itself has afunction as an imaging device. Further, this optical device is connectedto an external communication device to be able to transmit and receiveinformation thereto and therefrom. The optical device and communicationdevice form an imaging system according to the present invention.

Hereinafter, a configuration of an imaging system according to thisthird embodiment will be described.

Configuration of Imaging System

FIG. 14 is a diagram schematically illustrating a configuration of animaging system 1B according to a third embodiment of the presentinvention. FIG. 15 is a block diagram illustrating a configuration ofthe imaging system 1B.

The imaging system 1B includes: an optical device 2B and a communicationdevice 4 (FIG. 14 and FIG. 15) that are connected to be able to transmitand receive information to and from each other by wirelesscommunication; and an attachment 5 (FIG. 14).

Not being limited to wireless communication, the imaging system 1B maybe configured by connecting the optical device 2B and communicationdevice 4 such that transmission and reception of information arepossible between each other by wire communication.

Configuration of Attachment

The attachment 5 is a member that mechanically connects the opticaldevice 2B and communication device 4.

More specifically, the attachment 5 is, as illustrated in FIG. 14,attached to a back surface of the communication device 4. Further, theattachment 5 has an attachment hole 5A provided therein, which iscircular in a planar view, and into which the optical device 2B isfitted.

In a state where the optical device 2B and the communication device 4have been mechanically connected to each other via the attachment 5, thewhole shape of the imaging system 1B has a shape from which a digitalcamera is imagined.

The imaging system 1B is not limited to the configuration including theattachment 5, and may be configured by omitting the attachment 5.

Configuration of Optical Device

Examples of the optical device 2B include a first optical device havinga plurality of optical axes, and a second optical device having a singleoptical axis. As described above in the first embodiment, since thesecond optical device is of a well-known technique, hereinafter, aconfiguration of the first optical device will be described intensively.

The optical device 2B has, as illustrated in FIG. 15, a configurationapproximately similar to that of the optical device (FIG. 1) describedabove in the first embodiment. More specifically, the optical device 2Bincludes, in addition to the imaging optical unit 21, the drive unit 22,the position detecting unit 23, and the first recording unit 24, whichhave been described above in the first embodiment, a first communicationunit 25B, a first control unit 26B, a first imaging unit 27, and a firstmemory unit 28. Each of these members 21 to 24, 25B, 26B, and 27 isaccommodated inside a lens barrel 20, approximately the whole of thelens barrel 20 having a column shape. That is, the whole shape of theoptical device 2B has a shape approximately similar to the whole shapeof a so-called interchangeable lens.

The imaging optical unit 21 according to this third embodiment isdifferent from the imaging optical unit 21 described above in the firstembodiment in that in the imaging optical unit 21 according to thisthird embodiment, an image of condensed light is formed on an imagingplane of an imaging element forming the first imaging unit 27.

The first imaging unit 27 has a configuration and functions similar tothose of the imaging unit 31 described above in the first embodiment,and images a subject and generates image data, under control by thefirst control unit 26B.

The image data generated by the first imaging unit 27 are sequentiallystored in the first memory unit 28 under control by the first controlunit 26B.

The first communication unit 25B performs, under control by the firstcontrol unit 26B, wireless communication of various data includingsignals required in the communication with the communication device 4,according to a predetermined protocol.

The first control unit 26B has, in addition to functions similar tothose of the first control unit 26 described above in the firstembodiment, a function of transmitting, to the communication device 4,the latest image data stored in the first memory unit 28, thecharacteristic information stored in the first recording unit 24, andinformation related to a position of the telephoto lens 213 detected bythe position detecting unit 23, via the first communication unit 25B.

Configuration of Communication Device

The communication device 4 is a device that performs wirelesscommunication with the optical device 2B, and is configured as, forexample, a digital camera, a digital video camera, a portable telephone,or a tablet type portable device (in FIG. 14, the communication device 4is illustrated as a portable telephone (smartphone)).

Hereinafter, main parts of the present invention will be mainlydescribed, as a configuration of the communication device 4.

This communication device 4 has, as illustrated in FIG. 15, aconfiguration approximately similar to that of the imaging device 3(FIG. 1) described above in the first embodiment. More specifically, thecommunication device 4 includes, in addition to the display unit 32, theinput unit 33, and the second recording unit 36 described above in thefirst embodiment, a second imaging unit 31B, a second communication unit34B, a second memory unit 35B, and a second control unit 37B.

The second imaging unit 31B is provided on a back surface (FIG. 14), andunder control by the second control unit 37B, images a subject andgenerates image data. This second imaging unit 31B is configured byusing: an optical system 312 (FIG. 14) that forms a subject image; animaging element (illustration thereof omitted), such as a CCD, thatreceives the subject image formed by the optical system 312 and convertsthe subject image into an electrical signal; a signal processing unitthat generates digital image data by performing signal processing (A/Dconversion or the like) on the electrical signal (analog signal) fromthe imaging element; and the like.

The second communication unit 34B performs, under control by the secondcontrol unit 37B, wireless communication of various data includingsignals required in the communication with the optical device 2B,according to a predetermined protocol.

That is, the second communication unit 34B has a function as a thirdcommunication unit according to the present invention.

The second memory unit 35B stores therein the image data generated bythe second imaging unit 31B, and the image data, the characteristicinformation, and the like received via the second communication unit34B.

The second control unit 37B is configured by using a CPU or the like,and comprehensively controls operations of the communication device 4 byperforming transfer or the like of instructions and data correspondingto the respective units forming the communication device 4 according toinstruction signals or the like from the input unit 33. This secondcontrol unit 37B includes, as illustrated in FIG. 15, in addition to thelens position instructing unit 372, the image extracting unit 373, andthe display control unit 374 described above in the first embodiment, aninformation acquiring unit 371B and an imaging control unit 375B.

Similarly to the characteristic information acquiring unit 371 describedabove in the first embodiment, the information acquiring unit 371Bacquires characteristic information and acquires image data from theoptical device 2B, via the second communication unit 34B. Theinformation acquiring unit 371B stores the acquired characteristicinformation and image data in the second memory unit 35B.

If the communication device 4 is set in a communication shooting mode (amode for imaging a subject by using the optical device 2B), the imagingcontrol unit 375B records, into the image data recording unit 362,similarly to the imaging control unit 375 described above in the firstembodiment, image data and partial image data corresponding to imagesdisplayed by the display unit 32 when there has been a shootingoperation on the input unit 33 by a user of the communication device 4.

On the contrary, if the communication device 4 is set in a normalshooting mode (a mode for imaging a subject by using the second imagingunit 31B), the imaging control unit 375B records, into the image datarecording unit 362, the image data generated by the second imaging unit31B when there has been a shooting operation on the input unit 33 by auser of the communication device 4.

Operations of Imaging System

Next, operations of the above described imaging system 1B will bedescribed.

Hereinafter, as the operations of the imaging system 1B, operations ofthe optical device 2B and operations of the communication device 4 willbe described in order.

Operations of Optical Device

FIG. 16 is a flow chart illustrating the operations of the opticaldevice 2B.

If power of the optical device 2B is turned ON by an operation on aninput unit (illustration thereof omitted) by a user of the opticaldevice 2B (Step S201: Yes), the first control unit 26B transmits thecharacteristic information recorded in the first recording unit 24 tothe communication device 4 via the first communication unit 25B (StepS202) and causes the first imaging unit 27 to start imaging (Step S203).The image data generated by the first imaging unit 27 are sequentiallystored in the first memory unit 28.

In FIG. 16, for convenience of explanation, a sequence, in which StepS203 is executed after Step S202, is illustrated, but Steps S202 andS203 are actually executed approximately at the same time.

Subsequently, the first control unit 26B sequentially transmits, via thefirst communication unit 25B, the latest image data stored in the firstmemory unit 28, to the communication device 4 (Step S204).

Subsequently, the first control unit 26B determines whether or notpositional information of a lens having a changeable focus position (ifthe optical device 2B is the first optical device, the positionalinformation of the telephoto lens 213) has been received from thecommunication device 4 via the first communication unit 25B (Step S205).

If it is determined that the positional information of the lens has notbeen received (Step S205: No), the optical device 2B returns to StepS201.

On the contrary, if the first control unit 26B determines that thepositional information of the lens has been received (Step S205: Yes),while checking the position of the lens having the changeable focusposition detected by the position detecting unit 23 (if the opticaldevice 2B is the first optical device, the position on the optical axisAxO of the telephoto lens 213), the first control unit 26B causes thedrive unit 22 to operate to position the lens at a position based on thereceived positional information (Step S206). Thereafter, the opticaldevice 2B returns to Step S201.

Operations of Communication Device

FIG. 17 is a flow chart illustrating operations of the communicationdevice 4.

Hereinafter, the communication device 4 is assumed to be set in thecommunication shooting mode (the mode in which a subject is imaged byusing the optical device 2B).

If the power of the communication device 4 is turned ON by an operationon the input unit 33 by a user of the communication device 4 (Step S301:Yes), the information acquiring unit 371B requests the optical device 2Bto transmit the characteristic information and image data via the secondcommunication unit 34B. The information acquiring unit 371B determineswhether or not the characteristic information has been received from theoptical device 2B via the second communication unit 34B (Step S302).

If it is determined that the characteristic information has not beenreceived (Step S302: No), the communication device 4 returns to StepS301.

On the contrary, if the information acquiring unit 371B determines thatthe characteristic information has been received (Step S302: Yes), theinformation acquiring unit 371B determines whether or not the image datahave been received from the optical device 2B via the secondcommunication unit 34B (Step S303).

If it is determined that the image data have not been received (StepS303: No), the communication device 4 returns to Step S311.

On the contrary, if the information acquiring unit 371B determines thatthe image data have been received (Step S303: Yes), the informationacquiring unit 371B stores the received image data into the secondmemory unit 35B. The second control unit 37B then determines whether ornot a multi-eye lens is used, similarly to Step S104 described above inthe first embodiment (Step S304). That is, in this second embodimentalso, the second control unit 37B determines whether or not a multi-eyelens is used by communication of information with the optical device 2B(Steps S202 and S302).

If it is determined that a multi-eye lens is used (Step S304: Yes), thesecond control unit 37B executes Steps S305 to S310 similar to StepsS106 to S111 described above in the first embodiment. After Step S310,the communication device 4 proceeds to Step S311.

On the contrary, if it is determined that a multi-eye lens is not used(Step S304: No), the second control unit 37B executes Steps S312 to S315similar to Steps S114 to S117 described above in the first embodiment.After Step S315, the communication device 4 proceeds to Step S311.

After Step S310, after Step S315, or if it is determined, “No”, in StepS303, the second control unit 37B determines whether or not the power ofthe communication device 4 has been turned OFF by an operation on theinput unit 33 by a user of the communication device 4 (Step S311).

If the power of the communication device 4 has been turned OFF (StepS311: Yes), the communication device 4 ends this process.

On the contrary, if the state where the power is ON is continuing (StepS311: No), the communication device 4 returns to Step S303.

As described above, the communication device 4 according to this thirdembodiment (second control unit 37B) changes display control between thetime of using the first optical device and the time of using the secondoptical device by executing Steps S305 to S310 when the first opticaldevice is used and executing Steps S312 to S315 when the second opticaldevice is used.

That is, the communication device 4 has a function as a display deviceaccording to the present invention. Further, the second control unit 37Bhas a function as a control unit according to the present invention.

Like the above described third embodiment, even if the optical device 2Bis configured as a lens type camera by including the first imaging unit27 in the optical device 2B, and the imaging system 1B is configured byconnecting the optical device 2B with the communication device 4, suchas a smart phone, to be able to transmit and receive information to andfrom each other, effects similar to those described above in the firstembodiment are able to be achieved. For example, an image quality by alens having a narrow view angle (for telephotography) is able to beenhanced by various measures for improving qualities of images because asubject shot by this is also shootable via other lenses having a wideview angle. For example, distortion, a decrease in light quantity, orthe like at a periphery of a screen is able to be corrected by referringto an image of a wide angle lens, and qualities of images are able to beimproved by a super-resolution technique in the form of interpolatingthe image acquired by the wide angle lens. Since such correction effectsare able to be expected, it may have a smaller configuration. Similarly,needless to say, by using images acquired by a plurality of lenses,image qualities of images by wide angle lenses are able to be improvedand application of processing the images into a panoramic image or athree dimensional image is possible. This may be performed by thedisplay control unit 374 or the like of the communication device 4, andmay be aided by providing a dedicated circuit in the second control unit37B or recording a dedicated image processing program in the programrecording unit 361. Image qualities may be improved when the image dataare recorded, and application of transmitting the image data to theoutside and improving the image qualities at an external device is alsopossible. By the three dimensional information, artistic expression orthe like added with depth information becomes possible and even richerimage expression is realized. Since the communication device 4 is used,the imaging system 1B according to this third embodiment is configuredto be suitable for performing such image processing in cooperation withan external server or the like, by using various lines, includingtelephone lines, or the Internet also.

Fourth Embodiment

Next, a fourth embodiment of the present invention will be described.

In the description below, to configurations similar to those describedabove in the first embodiment, the same signs will be appended, anddetailed description thereof will be omitted or simplified.

A configuration of an imaging optical unit of a first optical deviceaccording to this fourth embodiment is different from that of the firstoptical device described above in the first embodiment.

Hereinafter, a configuration of the imaging optical unit according tothis fourth embodiment will be described.

Imaging Optical Unit

FIG. 18 is a diagram schematically illustrating a configuration of animaging optical unit 21C according to the fourth embodiment of thepresent invention. Specifically, FIG. 18 corresponds to FIG. 2 and is adiagram of the imaging optical unit 21C as viewed from a subject side.

The imaging optical unit 21C includes, as illustrated in FIG. 18, a fardistance wide angle lens 214F, a near distance wide angle lens 214N, afirst telephoto lens 215N, a second telephoto lens 215F, a thirdtelephoto lens 215M, a first focus adjustment lens 216A, and a secondfocus adjustment lens 216B.

In FIG. 18, similarly to FIG. 2, for convenience of explanation, each ofthe lenses 214F, 214N, 215N, 215F, 215M, 216A, and 216B is artificiallyillustrated as a single lens.

The far distance wide angle lens 214F is a wide angle lens having thesame function and same configuration as the first right wide angle lens211R described above in the first embodiment. That is, the far distancewide angle lens 214F has a function as a first imaging optical systemaccording to the present invention.

The far distance wide angle lens 214F is arranged in the same postureand same position as the first right wide angle lens 211R. That is, thefar distance wide angle lens 214F forms, on the imaging plane 311A, asubject image in an area Ar4F (FIG. 18) similar to the area Ar1Rdescribed above in the first embodiment.

The near distance wide angle lens 214N is a wide angle lens having thesame function and same configuration as the second left wide angle lens212L described above in the first embodiment. That is, the near distancewide angle lens 214N has a function as a first imaging optical systemaccording to the present invention.

The near distance wide angle lens 214N is arranged in the same postureand same position as the second left wide angle lens 212L. That is, thenear distance wide angle lens 214N forms, on the imaging plane 311A, asubject image in an area Ar4N (FIG. 18) similar to the area Ar2Ldescribed above in the first embodiment.

The first telephoto lens 215N is configured of a telephoto lens havingthe same focal distance as the telephoto lens 213 described above in thefirst embodiment and having a focus position at a near distance. Thatis, the first telephoto lens 215N has a function as a second imagingoptical system according to the present invention.

The first telephoto lens 215N is supported by a lens barrel(illustration thereof omitted) such that the first telephoto lens 215Nis postured and positioned as described below in a state where anoptical device 2C (FIG. 18) according to this fourth embodiment isattached to the imaging device 3.

The first telephoto lens 215N is supported by the lens barrel such thatthe first telephoto lens 215N is postured with its optical axis(illustration thereof omitted) being vertical to the imaging plane 311Aand the first telephoto lens 215N is positioned on the upper left of thecenter “O” of the imaging plane 311A as viewed from the subject side.That is, the first telephoto lens 215N forms a subject image in an areaAr5N on the upper left in the imaging plane 311A.

The second telephoto lens 215F is configured of a telephoto lens havingthe same focal distance as the telephoto lens 213 described above in thefirst embodiment and having a focus position at a far distance. That is,the second telephoto lens 215F has a function as a second imagingoptical system according to the present invention.

The second telephoto lens 215F is arranged in the same posture and sameposition as the telephoto lens 213. That is, the second telephoto lens215F forms, on the imaging plane 311A, a subject image in an area Ar5F(FIG. 18) similar to the area ArO described above in the firstembodiment.

The third telephoto lens 215M is configured of a telephoto lens havingthe same focal distance as the telephoto lens 213 described above in thefirst embodiment and having a focus position at a distance intermediatebetween those of the first and second telephoto lenses 215N and 215F.That is, the third telephoto lens 215M has a function as a secondimaging optical system according to the present invention.

The third telephoto lens 215M is supported by the lens barrel such thatthe third telephoto lens 215M is postured and positioned as describedbelow in a state where the optical device 2C according to this fourthembodiment is attached to the imaging device 3.

The third telephoto lens 215M is supported by the lens barrel such thatthe third telephoto lens 215M is postured with its optical axis(illustration thereof omitted) being vertical to the imaging plane 311Aand the third telephoto lens 215M is positioned on the lower right ofthe center “O” of the imaging plane 311A as viewed from the subjectside. That is, the third telephoto lens 215M forms a subject image in anarea Ar5M on the lower right in the imaging plane 311A.

The above described first to third telephoto lenses 215N, 215F, and 215Mare configured, similarly to the telephoto lens 213 described above inthe first embodiment, to be movable along their optical axes inside thelens barrel and such that their focus positions are changeable. That is,the optical device 2C according to this third embodiment has three ofthe drive units 22 and position detecting units 23 described above inthe first embodiment, correspondingly with the first to third telephotolenses 215N, 215F, and 215M.

The first and second focus adjustment lenses 216A and 216B are lensesused when AF is performed. That is, the first and second focusadjustment lenses 216A and 216B have a function as a focus opticalsystem according to the present invention.

The first and second focus adjustment lenses 216A and 216B are supportedby the lens barrel such that the first and second focus adjustmentlenses 216A and 216B are postured and positioned as described below inthe state where the optical device 2C according to this fourthembodiment has been attached to the imaging device 3.

The first and second focus adjustment lenses 216A and 216B are supportedby the lens barrel such that they are respectively positioned above andbelow the center “O” of the imaging plane 311A as viewed from thesubject side in a posture with their optical axes (illustration thereofomitted) being vertical to the imaging plane 311A. That is, the firstand second focus adjustment lenses 216A and 216B respectively formsubject images in an upper area Ar6A and a lower area Ar6B in theimaging plane 311A.

In the first recording unit 24 according to this fourth embodiment, foreach of the above described lenses 214F, 214N, 215N, 215F, 215M, 216A,and 216B, respective characteristic information (range information,optical axis coordinate information, focal distance information (viewangle information), focus adjustment information, use information, pairinformation, separation distance information, and the like) related tocharacteristics of the each of these lenses 214F, 214N, 215N, 215F,215M, 216A, and 216B is recorded.

Operations of Imaging System

Next, operations of an imaging system according to this fourthembodiment will be described.

FIG. 19 is a flow chart illustrating operations of the imaging systemaccording to the fourth embodiment.

The operations of the imaging system according to this fourth embodimentare different from the operations (FIG. 9) of the imaging systemdescribed above in the first embodiment only in that, as illustrated inFIG. 19, Steps S125 and S126 are added, and Step S106C is used insteadof Step S106.

Therefore, hereinafter, only Steps S125, S126, and S106C will bedescribed.

A lens position instructing unit 372 according to this fourth embodimentexecutes an AF process for the first to third telephoto lenses 215N,215F, and 215M, which are the lenses with changeable focus positions,from the lenses included in the optical device 2C, at Steps S106C, S125,S107, and S126.

Specifically, the lens position instructing unit 372 calculates asubject distance, as described below, at Step S106C.

That is, the lens position instructing unit 372 identifies, based on theuse information and pair information included in the characteristicinformation (characteristic information acquired from the optical device2C) stored in the memory unit 35, lenses of a pair to be used when AF ofthe first to third telephoto lenses 215N, 215F, and 215M is performed,to be the first and second focus adjustment lenses 216A and 216B.Further, the lens position instructing unit 372 recognizes, based on therange information included in the characteristic information stored inthe memory unit 35, the areas Ar6A and Ar6B, where the first and secondfocus adjustment lenses 216A and 216B form the subject images in theimaging plane 311A. The lens position instructing unit 372 then readsthe latest image data stored in the memory unit 35, and based on theposition of the subject image photographed in the area Ar6A or area Ar6Bin the image area of the latest image data, similarly to the abovedescribed first embodiment, calculates a subject distance by using theprinciple of triangulation.

Subsequently, the lens position instructing unit 372 determines whetheror not a subject distance has been able to be calculated in Step S106C(Step S125).

Cases where a subject distance has not been able to be calculatedinclude, for example, a case where the contrast of the partial imagedata corresponding to the area Ar6A or area Ar6B is low, and a casewhere a subject image (“bird” or the like as in the example of FIG. 7)is not included in the partial image data.

If it is determined that a subject distance has been able to becalculated (Step S125: Yes), the lens position instructing unit 372acquires, based on the focus adjustment information included in thecharacteristic information stored in the memory unit 35, positions ofthe first to third telephoto lenses 215N, 215F, and 215M correspondingto the calculated subject distance and transmits positional informationrelated to the acquired positions of the first to third telephoto lenses215N, 215F, and 215M to the optical device 2C via the secondcommunication unit 34 (Step S107).

On the contrary, if it is determined that the subject distance has notbeen able to be calculated (Step S125: No), the lens positioninstructing unit 372 transmits, in order to position the first to thirdtelephoto lenses 215N, 215F, and 215M at prescribed positions that havebeen determined beforehand, the positional information related to theprescribed positions recorded in the second recording unit 36 to theoptical device 2C via the second communication unit 34 (Step S126). Thatis, Step S126 aims to bring an image acquired by any of the first tothird telephoto lenses 215N, 215F, and 215M (an image corresponding tothe area Ar5N, Ar5F, or Ar5M) into focus, by positioning the first tothird telephoto lenses 215N, 215F, and 215M at the prescribed positions.

Further, at Step S111, the image extracting unit 373 according to thisfourth embodiment respectively extracts, based on the range informationor the like included in the characteristic information (characteristicinformation acquired from the optical device 2C) stored in the memoryunit 35, the partial image data corresponding to the areas Ar4F, Ar4N,Ar5N, Ar5F, and Ar5M based on the range information, from the image areaof the latest image data.

Even if the imaging optical unit 21C is configured as described above inthis fourth embodiment, effects similar to those of the above describedfirst embodiment are able to be achieved.

Fifth Embodiment

Next, a fifth embodiment of the present invention will be described.

In the description below, to configurations similar to those of theabove described fourth embodiment, the same signs will be appended, anddetailed description thereof will be omitted or simplified.

A configuration of an imaging optical unit of an optical deviceaccording to this fifth embodiment is different from that of the opticaldevice 2C described above in the fourth embodiment.

Hereinafter, a configuration of the imaging optical unit according tothis fifth embodiment will be described.

Configuration of Imaging Optical Unit

An imaging optical unit 21D according to this fifth embodiment isdifferent from the imaging optical unit 21C described above in thefourth embodiment in that the first and second focus adjustment lenses216A and 216B are omitted, and the second telephoto lens 215F isconfigured of a diffraction lens.

FIG. 20A and FIG. 20B are diagrams schematically illustrating the secondtelephoto lens 215F according to the fifth embodiment of the presentinvention. Specifically, FIG. 20A is a diagram of the second telephotolens 215F as viewed from the side. FIG. 20B is an enlarged diagram of asurface of the second telephoto lens 215F.

The second telephoto lens 215F according to this fifth embodiment isconfigured of a diffraction lens having concavity and convexity formedon its surface, as illustrated in FIG. 20A or FIG. 20B.

The second telephoto lens 215F forms an image of zero-order light in thearea Ar5F described above in the fourth embodiment in the imaging plane311A. Further, the second telephoto lens 215F respectively forms imagesof positive first-order light and negative first-order light, which arediffracted light, over the areas Ar6A and Ar6B described above in thefourth embodiment in the imaging plane 311A.

In this fifth embodiment, characteristic information of the secondtelephoto lens 215F is different from the characteristic informationdescribed above in the fourth embodiment.

Specifically, range information thereof is information corresponding tothe above described areas Ar5F, Ar6A, and Ar6B. Use information thereofis information indicating that the lens is a lens to be used when AF isperformed.

At Step S106C, the lens position instructing unit 372 according to thisfifth embodiment calculates, based on the characteristic informationstored in the memory unit 35, a subject distance, based on a position ofa subject image photographed in the area Ar6A or area Ar6B in the imagearea of the latest image data.

When the imaging optical unit 21D is configured as described above inthis fifth embodiment, as compared with the above described fourthembodiment, AF of the first to third telephoto lenses 215N, 215F, and215M is able to be performed while being able to omit the first andsecond focus adjustment lenses 216A and 216B.

Other Embodiments

Thus far, modes for carrying out the present invention have beendescribed, but the present invention is not to be limited only to theabove described first to fifth embodiments. In particular, although thedescription has been made by using the expression “the latest” in thesentences, according to the system configuration or performance, theperformance limit of the software, the response speed of users, and thelike, those deviated from the latest timing may be adapted asappropriate so long as no contradiction arises in the concept of thepresent invention.

Although each of the imaging optical units 21, 21C, and 21D according tothe above described first to fifth embodiments is configured bycombining lenses of different types (wide angle lenses and telephotolenses), not being limited thereto, it may be configured by combininglenses of the same type (wide angle lenses or telephoto lenses).

The posture and arrangement position of each lens forming the imagingoptical units 21, 21C, and 21 d according to the above described firstto fifth embodiments are not limited to the postures and arrangementpositions described in the above described first to fifth embodiments,and other postures and arrangement positions may be used.

For example, in the imaging optical unit 21, the posture of each of thefour wide angle lenses 211L, 211R, 212L, and 212R may be changed asdescribed below.

Specifically, the first left wide angle lens 211L may be arranged in aposture directed to the left side or diagonally to the upper left side,as viewed from the subject side. The first right wide angle lens 211Rmay be arranged in a posture directed to the right side or diagonally tothe upper right side, as viewed from the subject side. The second leftwide angle lens 212L may be arranged in a posture directed to the leftside or diagonally to the lower left side, as viewed from the subjectside. The second right wide angle lens 212R may be arranged in a posturedirected to the right side or diagonally to the lower right side, asviewed from the subject side. That is, each of the four wide anglelenses 211L, 211R, 212L, and 212R may be arranged in a posture directedto the outside to have a tilt or a shift.

Although in the above described first to fifth embodiments, the areasAr1L, Ar1R, Ar2L, Ar2R, ArO, Ar4F, Ar4N, Ar5N, Ar5F, Ar5M, Ar6A, andAr6B used in extracting the partial image data are rectangular areasthat are long sideways, not being limited thereto, they may berectangular areas that are vertically long.

In the above described first to fifth embodiments, a hand-shakecorrection mechanism for performing hand-shake correction may beprovided. For example, an optical hand-correction mechanism, whichperforms hand-shake correction by moving at least a part of the lensgroups forming the telephoto lens 213 (first to third telephoto lenses215N, 215F, and 215M), may be used.

Although in the above described first and third to fifth embodiments,the extraction of the partial image data (Step S108 or S307) wasexecuted before the live view display (Step S109 or S308), limitation isnot made thereto. For example, it may be configured such that in thelive view display (Step S109 or S308), approximately the whole of theimage captured by the imaging element 311 is displayed by the displayunit 32, and if there is a shooting operation (Step S116: Yes, or StepS309: Yes), extraction of the partial image data (Step S108 or S308) isexecuted.

Further, the process flows are not limited to the sequences of theprocesses in the flow charts described above in the first to fifthembodiments, and may be changed so long as no contradiction arises.

Further, algorithms of the processes described by using the flow chartsin this specification may be described as programs. Such a program maybe recorded in a recording unit inside a computer or recorded in acomputer readable recording medium. Recording of the program in therecording unit or recording medium maybe performed when the computer orrecording medium is shipped as a product or may be performed bydownloading via a communication network.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. An imaging system, comprising: an imaging device;and an optical device that forms a subject image on an imaging plane ofan imaging element and that is freely attachable to and detachable fromthe imaging device, wherein the optical device includes a combination ofa plurality of optical systems to provide a plurality of optical axes,the plurality of optical systems include: a plurality of first imagingoptical systems; and a second imaging optical system having a view anglenarrower than that of each of the plurality of first imaging opticalsystems, and the plurality of first imaging systems are respectivelyarranged to surround the second imaging optical system, as viewed from asubject side, wherein, when the optical device is attached to theimaging device, each of the plurality of first imaging optical systemsis fixed with respect to an optical axis normal to an imaging plane ofthe imaging device, but the second imaging optical system is movablealong the optical axis.
 2. The imaging system according to claim 1,wherein the optical device includes: a characteristic informationrecording unit that records therein respective characteristicinformation related to characteristics of the plurality of opticalsystems; and a first communication unit that is connected to an externaldevice to transmit and receive information to and from the externaldevice and that transmits the characteristic information to the externaldevice, the characteristic information includes range informationrelated to ranges occupied by respective subject images formed by theplurality of first imaging optical systems and the second imagingoptical system on the imaging plane of the imaging element, the imagingdevice includes: the imaging element that is provided singly and thathas the imaging plane that covers the ranges occupied by the respectivesubject images; a second communication unit that is connected to theoptical device to transmit and receive information to and from theoptical device and that receives the characteristic informationtransmitted from the first communication unit; and an image extractingunit that extracts, based on the range information included in thecharacteristic information received by the second communication unit,respective images corresponding to the ranges occupied by the respectivesubject images in the whole image area of an image captured by theimaging element.
 3. The imaging system according to claim 2, wherein theimaging device further includes: a display unit; and a display controlunit that causes the display unit to display the respective imagesextracted by the image extracting unit by lining up the respectiveimages.
 4. The imaging system of claim 2 wherein, the characteristicinformation includes, for each of the plurality of first imaging opticalsystems, at least one of (A) use information specifying whether or notthe first imaging optical system is to be used for auto focusing, (B)pair information grouping at least two of the first imaging opticalsystems to be used for autofocusing, and (C) separation distanceinformation specifying a distance to a pair of first imaging opticalsystems.
 5. The imaging system according to claim 1, wherein the opticaldevice includes: a characteristic information recording unit thatrecords therein respective characteristic information related tocharacteristics of the plurality of optical systems; and a drive unitthat changes a focus position of at least one of the plurality ofoptical systems, the plurality of first imaging optical systems includea pair of focus optical systems that are used for respectively formingsubject images on the imaging plane of the imaging element and adjustingthe focus position, and the characteristic information related to thecharacteristics of one of the pair of focus optical systems include pairinformation indicating the other of the pair of focus optical systemsthat is to be used together with the one of the pair of focus opticalsystems.
 6. A display system, comprising: a display device; and anoptical device that forms a subject image on an imaging plane of animaging element, that is freely attachable to and detachable from thedisplay device, and that is freely attachable to and detachable from animaging device, wherein the optical device includes: a plurality ofoptical systems that have a plurality of optical axes with differentview angles and that respectively form subject images of a plurality ofdifferent view angles on the imaging plane of the imaging element; and atransmitting unit that transmits positional information related topositions at which the subject images are formed, and the display deviceincludes: a receiving unit that receives, when the optical device isattached to the display device, the positional information from theoptical device; and a display control unit that causes display of thesubject images of the plurality of different view angles to bechangeable according to a result of reception by the receiving unit,wherein the plurality of optical systems include: a plurality of firstimaging optical systems; and a second imaging optical system having aview angle narrower than that of each of the plurality of first imagingoptical systems, and the plurality of first imaging optical systems arerespectively arranged to surround the second imaging optical system, asviewed from a subject side, and wherein, when the optical device isattached to the imaging device, each of the plurality of first imagingoptical systems is fixed with respect to an optical axis normal to animaging plane of the imaging device, but the second imaging opticalsystem is movable along the optical axis.
 7. An optical device,comprising: an imaging optical unit that includes a combination of aplurality of optical systems to provide a plurality of optical axes,that respectively forms a plurality of subject images on an imagingplane of an imaging element by the plurality of optical systems, andthat is freely attachable to and detachable from an imaging device; acharacteristic information recording unit that records thereinrespective characteristic information related to characteristics of therespective optical systems constituting the imaging optical unit; and atransmitting unit that transmits the characteristic information to adevice that performs imaging in cooperation with the optical device,wherein the plurality of optical systems include: at least one firstimaging optical system; and a second imaging optical system having aview angle narrower than that of the at least one first imaging opticalsystem, wherein the at least one first imaging optical system includes aplurality of first imaging optical systems; and the plurality of firstimaging optical systems are respectively arranged to surround the secondimaging optical system, as viewed from a subject side, and wherein, whenthe optical device is attached to the imaging device, each of theplurality of first imaging optical systems is fixed with respect to anoptical axis normal to an imaging plane of the imaging device, but thesecond imaging optical system is movable along the optical axis.
 8. Theoptical device of claim 7, wherein the characteristic informationincludes range information related to ranges occupied by the respectivesubject images formed by the plurality of optical systems on the imagingplane of the imaging element.
 9. The optical device of claim 7, furthercomprising a drive unit that changes a focus position of at least one ofthe plurality of optical systems, wherein the imaging optical unitincludes a pair of focus optical systems that are used for respectivelyforming subject images on the imaging plane of the imaging element andadjusting the focus position, and the characteristic information relatedto the characteristics of one of the pair of focus optical systemsinclude pair information indicating the other of the pair of focusoptical systems that is to be used together with the one of the pair offocus optical systems.
 10. The optical device according to claim 9,wherein the at least one first imaging optical system includes aplurality of first imaging optical systems; and the plurality of firstimaging optical systems include the pair of focus optical systems. 11.The optical device of claim 7, wherein the second imaging optical systemincludes a diffraction lens.
 12. The optical device of claim 7 wherein,the characteristic information includes, for each of the plurality offirst imaging optical systems, at least one of (A) use informationspecifying whether or not the first imaging optical system is to be usedfor auto focusing, (B) pair information grouping at least two of thefirst imaging optical systems to be used for autofocusing, and (C)separation distance information specifying a distance to a pair of firstimaging optical systems.